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Abstract 

Let G be a real Lie group and H a lattice or, more generally, a 
closed subgroup of finite covolume in G. We show that the unitary 
representation Xq/h of G on L?'{G/H) has a spectral gap, that is, the 
restriction of \g/h to the orthogonal of the constants in Lp'{G/H) 
does not have almost invariant vectors. This answers a question of 
G. Margulis. We give an application to the spectral geometry of locally 
symmetric Riemannian spaces of infinite volume. 

1 Introduction 

Let G a locally compact group. Recall that a unitary representation (vr, Ti) of 
G almost has invariant vectors if, for every compact subset Q oiG and every 
£ > 0, there exists a unit vector ^ G 7i such that sup^,gQ ||7r(a;),^ — ^|| < £. If 
this holds, we also say that the trivial representation 1^ is weakly contained 
in TT and write 1g -< vr. 

Let if be a closed subgroup of G for which there exists a G-invariant 
regular Borel measure fi on G/H (see |BHVt Appendix B] for a criterion of 
the existence of such a measure). Denote by Xg/h the unitary representation 
of G given by left translation on the Hilbert space L'^{G/H, /i) of the square 
integrable measurable functions on the homogeneous space G/H. If /i is finite, 
we say that H has finite covolume in G. In this case, the space C1g/h of the 
constant functions on G/H is contained in L'^{G/H, /x) and is G-invariant as 
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well as its orthogonal complement 



Ll{G/H,fi) = |e G L\G/H,fi) : j^^J{x)dfi{x) = o| . 

In case is infinite, we set Lq{G/ H, n) = L'^{G/ H, fi). 

Denote by A^^^^ the restriction of Xq/h to Lq{G/ H, fi) (in case /i is infinite, 
Xq/jj = Xg/h)- We say that Xg/h (or L'^{G/ H, ^)) has a spectral gap if X^^j^ 
has no almost invariant vectors. In the terminology of |Marg91 , Chapter III. 
(1.8)], H is called weakly cocompact. 

By a Lie group we mean a locally compact group G whose connected 
component of the identity G^ is open in G and is a real Lie group. We 



prove the following result which has been conjectured in MargOl Chapter 
III. Remark 1.12]. 

Theorem 1 Let G be a Lie group and H a closed subgroup with finite covol- 
ume in G. Then the unitary representation Xg/h on L'^{G/H) has a spectral 
gap. 

It is a standard fact that L^[G/H) has a spectral gap when H is co- 



compact in G (see MargQl, Chapter III, Corollary 1.10]). When G is a 
semisimple Lie group. Theorem [T] is an easy consequence of Lemma 3 in 
|Bekk98j . Our proof is by reduction to these two cases. The crucial tool 



for this reduction is Proposition (1.11) from Chapter III in MargQl | (see 



Proposition [5] below). From Theorem [T] and again from this proposition, we 
obtain the following corollary. 

Corollary 2 Let G be a second countable Lie group, H a closed subgroup 
with finite covolume in G and a a unitary representation of H. Letir = Ind^cr 
be the representation of G induced from a. If 1h is not weakly contained in 
0", then 1g is not weakly contained in it. 

Observe that, by continuity of induction, the converse result is also true: if 
1h -< cr, then 1^ -< vr. 

From the previous corollary we deduce a spectral gap result for some 
subgroups of G with infinite covolume. 

Recall that a subgroup H of a topological group G is called co- amenable in 
G if there is a G-invariant mean on the space G^{G/H) of bounded continuous 
functions on G/H. When G is locally compact, this is equivalent to l^ -< 
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^G/H] this property has been extensively studied by Eymard |Eyma72| for 
which he refers to as the amenabihty of the homogeneous space G/H. Observe 
that a normal subgroup if in G is co-amenable in G if and only if the quotient 
group G/H is amenable. 

Corollary 3 Let G be a second countable Lie group and H a closed subgroup 
with finite covolume in G. Let L be a closed subgroup of H . Assume that L 
is not co-amenable in H. Then Xg/l has a spectral gap. 

Corollary [3] is a direct consequence of Corollary [2], since the representation 
Xg/l on L'^{H/L) is equivalent to the induced representation Ind^Xn/L- 

Here is a reformulation of the previous corollary. Let G be a Lie group 
and H a closed subgroup with finite covolume in G. If a subgroup L of if is 
co-amenable in G, then L is co-amenable in H. Observe that the converse (if 
L is co-amenable in H, then L is co-amenable in G) is true for any topological 
group G and any closed subgroup H which is co- amenable in G (see |Eyma72" 
P-16]). 

Using methods from |Leuz03j (see also |Broo86j ). we obtain the following 
consequence for the spectral geometry of infinite coverings of locally symmet- 
ric Riemannian spaces of finite volume. Recall that a lattice in the locally 
compact group G is a discrete subgroup of G with finite covolume. 

Corollary 4 Let G be a semisimple Lie group with finite centre and maximal 
compact subgroup K and let T be a torsion-free lattice G. Let V be a covering 
of the locally symmetric space V = K\G/r. Assume that the fundamental 
group ofV is not co-amenable in T. 

(i) We have h{y) > for the Cheeger constant h{V) ofV. 

(a) We have Ao(V^) > 0, where Ao(V^) is the bottom of the -spectrum of 
the Laplace- Beltrami operator on V. 

There is in general no uniform bound for h{V) or Ao(V^) for all coverings V. 
However, it was shown in [Leuz03j that, when G has Kazhdan's Property 
(T), such a bound exists for every locally symmetric space V = K\G/V. 
Observe also that if, in the previous corollary, the fundamental group of V 
is co-amenable in F and has infinite covolume, then hiV) = Ao(^) = 0, as 
shown in |Broo81] . 
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2 Proofs of Theorem [T] and Corollary [4] 



The following result of Margulis (Proposition (1.11) in Chapter III of Marg91| ) 
wil be crucial. 

Proposition 5 (IMargQl^ ) Let G be a second countable locally compact 
group, H a closed subgroup of G, and a a unitary representation of H. As- 
sume that \g/h has a spectral gap and that 1h is not weakly contained in a. 
Then Iq is not weakly contained in Ind^o". 

In order to reduce the proof of Theorem [1] to the semisimple case, we will 
use several times the following proposition. 

Proposition 6 Let G a separable locally compact group and Hi and H2 be 

closed subgroups of G with Hi C H2 and such that G/ H2 and H2/H1 have G- 
invariant and H2-invariant regular Borel measures, respectively. Assume that 
the H2-representation XH2/H1 on L'^{H2/Hi) and that the G -representation 
Xg/H2 on L'^iG/ H2) have both spectral gaps. Then the G -representation Xg/Hi 
on L'^{G/Hi) has a spectral gap. 

Proof Recall that, for any closed subgroup H of G, the representation 
\g/h is equivalent to the representation Ind^l^ induced by the identity 
representation 1h of H. Hence, we have, by transitivity of induction, 

\g/h, = Ind|^l/fi = Indg^(IndglHj = \nd%XH,/H,. 
We have to consider three cases: 

• First case: Hi has finite covolume in G, that is. Hi has finite covolume in 
H2 and H2 has finite covolume in G. Then 

By assumption, X^h^i^^ and A^^^:^^ do not weakly contain and 1^, re- 
spectively. It follows from Proposition [5] that Ind^^-^^^^j:^^ does not weakly 
contain Ig. Hence, X^g/Hi "^^^^ weakly contain 1^- 

• Second case: Hi has finite covolume in H2 and H2 has infinite covolume in 
G. Then 

Ag/Hi = Xg/H2 © Ind^^A^/j/^^. 
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By assumption, ^^jj^/jj^ and Xg/H2 do not weakly contain and 1^. As 
above, using Proposition 0, we see that \g/Hi does not weakly contain 1^. 

• Third case: Hi has infinite covolume in H2. By assumption, A^a/Hi does 
not weakly contain 1h2- By Proposition [5] again, it follows that \g/Hi = 
lndjj^XH2/Hi does not weakly contain 1^- ■ 

For the reduction of the proof of Theorem [1] to the case where G is second 
countable, we will need the following lemma. 

Lemma 7 Let G be a locally compact group and H a closed subgroup with 
finite covolume. The homogeneous space G/H is a-compact. 

Proof Let yU be the G-invariant regular probability measure on the Borel 
subsets of G/H. Choose an increasing sequence of compact subsets Kn of 
G/H with lim„ /i(i^'n) = 1- The set K = [J^Kn has /i-measure 1 and is 
therefore dense in G/H. Let U he a compact neighbourhood of e in G. Then 
UK = G/H and UK = U„ UK^ is a-compact. ■ 

Proof of Theorem [1] 

Through several steps the proof will be reduced to the case where H is 
a lattice in G and where G is a connected semisimple Lie group with trivial 
centre and without compact factors. 

• First step: we can assume that G is cr-compact and hence second-countable. 
Indeed, let p : G ^ G/H be the canonical projection. Since every compact 
subset of G/H is the image under p of some compact subset of G (see |BHV[ 
Lemma B.Ll]), it follows from Lemma[7]that there exists a cr-compact subset 
K of G such that p{K) = G/H. Let L be the subgroup of G generated by 
KUU for a neighbourhood f/ of e in G. Then L is a a-compact open subgroup 
of G. We show that L (1 H has a finite covolume in L and that Xq/h has a 
spectral gap if Xl/ldh has a spectral gap. 

Since LH is open in G, the homogeneous space L/LCiH can be identified 
as L-space with LH/H. Therefore L (1 H has finite covolume in L. On 
other hand, the restriction of Xg/h to L is equivalent to the L- representation 
^L/LnH, since LH/H = p{L) = G/H. Hence, if Xl/lc^h has a spectral gap, 
then Xg/h has a spectral gap. 

• Second step: we can assume that G is connected. Indeed, let G^ be the 
connected component of the identity of G. We show that G° fl if has a finite 
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covolume in and that \g/h has a spectral gap if Xgo/gohh has a spectral 
gap. 

The subgroup G^H is open in G and has finite covolume in G as it contains 
H. It follows that G^H has finite index in G since G/G^H is discrete. Hence 
^G/GOR has a spectral gap. 

On the other hand, since G^H is closed in G, the homogeneous space 
G^G^ n H can be identified as a G°-space with G^H/H. Therefore G° n H 
has finite covolume in G^. The restriction of Xgoh/h to is equivalent to 
the G°-representation Xgo/gohh- 

Suppose now that Xgo/gohh has a spectral gap. Then the G°if-represent- 
ation Xgoh/h has a spectral spectral, since Lq{G^H/H) = Ll{G^/G^ fl H) 
as Go-representations. An application of Proposition E] with Hi = H and 
if2 = G^H shows that Xg/h has a spectral gap. Hence, we can assume that 
G is connected. 

• Third step: we can assume that if is a lattice in G. Indeed, let be the 
connected component of the identity of H and let Ng{H^) be the normalizer 
of in G. Observe that Ng{H^) contains H. By | Wang76 , Theorem 3.^ 



NGiH'^) is cocompact in G. Hence, XG/NoiHO) has a spectral gap. It follows 
from the previous proposition that Xg/h has a spectral gap if Xn^(^ho)/h has 
a spectral gap. 

On the other hand, since is a normal subgroup of if, we have 

LI{Ng{H')/H) = LI{{Ng{H')/H')/{H/H')), 

as Ai'G'(-fi°) -representations. Hence, Xj\f^(^HO)/H has a spectral gap if and only 
if A^v/H has a spectral gap, where N = Ng{H^)/H^ and H = H/H^. 

The second step applied to the Lie group N /H shows that A^y/T/ has a 
spectral gap if '^7v''/(7v°ni7) ^ spectral gap. Observe that fl /i is a 

lattice in the connected Lie group A^°, since H is discrete and since H has 
finite covolume in Ng{H^)- 

This shows that we can assume that if is a lattice in the connected Lie 
group G. 

• Fourth step: we can assume that G is a connected semisimple Lie group 
with no compact factors. Indeed, let G = SR be a Levi decomposition of 
G, with R the solvable radical of G and S a semisimple subgroup. Let G 



be the maximal compact normal subgroup of S. It is proved in Wang70 



Theorem B, p. 21] that HGR is closed in G and that HGR/H is compact. 
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Hence, by the previous proposition, Xq/h has a spectral gap if Xg/hcr has a 
spectral gap. 

The quotient G = G/CR is a connected semisimple Lie group with 
no compact factors. Moreover, H = HGR/GR is a lattice in G since 
HCR/CR = H/H n GR is discrete and since HGR has finite covolume 
in G. Observe that Xg/hcr is equivalent to Xq^jj as G- representation. 

• Fifth step: we can assume that G has trivial centre. Indeed, let Z be the 
centre of G. It is known that ZH is discrete (and hence closed) in G (see 
|Ragh72[ Chapter V, Corollary 5.17]). Hence, ZH/ H is finite and Xzh/h has 
a spectal gap. 

By the previous proposition, Xg/h has a spectral gap if Xg/zh has a 
spectral gap. Now, G = G/Z is a connected semisimple Lie group with no 
compact factors and with trivial centre, H = ZH/Z is a lattice in G and 
Xg/zh is equivalent to Xq^-jj. 

• Sixth step: by the previous steps, we can assume that if is a lattice in a 
connected semisimple Lie group G with no compact factors and with trivial 
centre. In this case, the claim was proved in Lemma 3 of |Bekk98j. This 
completes the proof of Theorem [TJB 



Proof of Corollary [J] 

The proof is identical with the proof of Theorems 3 and 4 in [Leuz03j ; we 
give a brief outline of the arguments. Let A be the fundamental group of V. 
First, it suffices to prove Claims (i) and (ii) for G/T instead of K\G/T (see 
Section 4 in |Leuz03] ). So we assume that V = G/A. 

Equip G with a right invariant Riemannian metric and G/A with the 
induced Riemannian metric. Observe that G/A has infinite volume, since 
A is of infinite index in F. Claim (ii) is a consequence of (i), by Cheeger's 

inequality -h^G/A)"^ < Xq{G/A). Recall that the Cheeger constant h{G/A) 

of G/A is the infimum over all numbers A{dQ)/V{Q), where Q is an open 
submanifold of G/A with compact closure and smooth boundary dQ, and 
where V{Q) and A{dQ) are the Lebesgue measures of fl and dQ. 

To prove Claim (i), we proceed exactly as in |Leuz03] . By Corollary [3l 
there exists a compact neighbourhood H of the identity in G and a constant 
e > such that 

(*) eUW < sup.e/^ \\XG/Am - ell, for all ^ G L'{G/A). 
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Let Q be an open submanifold of G/A with compact closure and smooth 
boundary dQ. By |Leuz03[ Proposition 1], we can find an open subset Q of 
G/A compact closure and smooth boundary such that, for all h & H, 

(**) v{U\,\{dn))<cv{n)^^, 

where the constant C > only depends on H. Here, \h\ denotes the distance 
dG{e,g) of h to the group unit and, for a subset S of G/A, Ur{S) is the 
tubular neighbourhood 

Ur{dn) = {xe G/A : dc/Aix, S) < r} 

By Inequality (*), applied the characteristic function Xq of fl, there exists 
h E H such that 

e^V{n)<\\\G,K{h)x~^-Xn\? = V{X), 

where 

X = |x G G/A : xen,hx^ dn^ U ^ : x^h,hxe dU^ . 

One checks that X C U\h\{dfl). It follows from Inequalities (*) and (**) that 
i < Heuce. < 1^ < l,(G/A). M 
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